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Abstract 

In this paper, distributed Bayesian detection problems with unknown prior probabilities of hypotheses 
are considered. The sensors obtain observations which are conditionally dependent across sensors and 
their probability density functions (pdf) are not exactly known. The observations are quantized and are 
sent to the fusion center. The fusion center fuses the current quantized observations and makes a final 
decision. It also designs (updated) quantizers to be used at the sensors and the fusion rule based on all 
previous quantized observations. Information regarding updated quantizers is sent back to the sensors for 
use at the next time. In this paper, the conditional joint pdf is represented in a parametric form by using the 
copula framework. The unknown parameters include dependence parameters and marginal parameters. 
Maximum likelihood estimation (MLE) with feedback based on quantized data is proposed to estimate 
the unknown parameters. These estimates are iteratively used to refine the quantizers and the fusion rule 
to improve distributed detection performance by using feedback. Numerical examples show that the new 
detection method based on MLE with feedback is much better than the usual detection method based on 
the assumption of conditionally independent observations. 

keywords: Bayesian detection, copula-based dependence modeling, copulas, maximum likelihood estima- 
tion, distributed detection, information fusion 

1 Introduction 

Distributed detection has received considerable attention over the last few decades (TJ |2l [3l 01 HJ. The 
Bayesian formulation of distributed detection was first considered by Tenney and Sandell [6] for parallel 

*This work was supported in part by U.S. Air Force Office of Scientific Research (AFOSR) under Grants FA9550-10-1-0263 and 
FA9550-10-1-0458 and in part by the NNSF of China (# 61004138 and 61273074). 

^ Xiaojing Shen and Pramod K. Varshney (corresponding author, varshney@syr.edu) are with the Department of Electrical Engi- 
neering and Computer Science, Syracuse University, NY, 13244, USA. Yunmin Zhu is with Department of Mathematics, Sichuan 
University, Chengdu, Sichuan 610064, China. Xiaojing Shen (shenxj@scu.edu.cn) is on leave from Department of Mathematics, 
Sichuan University, Chengdu, Sichuan 610064, China. 



1 



sensor network structures. For conditionally independent sensor observations, they proved that the optimal 
decision rules at the sensors are likelihood ratio (LR) quantizers. The optimal thresholds to quantize LR at 
individual sensors can be determined by solving a set of coupled nonlinear equations. When the quantizers 
are fixed, Chair and Varshney in [7 ] derived an optimum fusion rule, once again based on the LR test. Over 
the past several years, many excellent results on distributed detection based on the assumption of condition- 
ally independent sensor observations have been derived that are available in [ 1 ] and references therein. The 
emerging wireless sensor networks (H motivated the optimality of LR quantizers to be extended to non-ideal 
detection systems where sensor outputs are to be communicated through noisy, possibly coupled channels to 
the fusion center ||9l[T0l. 

When sensor observations are dependent, Tsitsiklis and Athans ifTTI provided a rigorous mathematical 
analysis demonstrating the computational difficulty in obtaining the optimum quantizers. Some progress has 
been made for the dependent observations case (see lfl2llT3l[T4l[T5Tl ). For example, difficulties encountered 
when dealing with dependent observations were discussed in [14]. In |[T6l , for distributed dependent ob- 
servations and a fixed fusion rule, the authors proposed a computationally efficient iterative algorithm for 
computing a discrete approximation of the optimal quantizers. The finite-step convergence of this algorithm 
was proved. By combining the methods proposed in (7J and |[T6l , an efficient algorithm to simultaneously 
search for the optimal fusion rule and the optimal quantizers was derived in IfTTI . Recently, the authors of 
|[T8l introduced a new framework for distributed detection with conditionally dependent observations. The 
new framework can identify several classes of problems with dependent observations whose optimal quan- 
tizers resemble the ones for the independent case. In addition, copula-based distributed Neyman-Pearson 
detection and hypothesis testing using heterogeneous dependent data have been proposed in |[T9l |20l . The 
copula based approach provides a systematic and elegant approach to characterize dependence and obtain 
decision rules at the sensors and the fusion center. 

In all previous studies on distributed Bayesian detection with dependent observations IfTTI [T2l[T3l [141 [151 
IT6l IT71 IT8l . the conditionally dependent joint pdfs of the sensor observations are assumed known. When 
the dependence among sensors is unknown, the usual approach is to ignore dependence and assume that the 
sensor observations are independent. The focus of this paper is distributed Bayesian detection in the context 
of unknown conditionally dependent pdfs. We also assume that prior probabilities of the hypotheses are 
unknown. The specific scenario (see Figure [TJ is that the sensors obtain observations which are conditionally 
dependent across sensors. The observations are quantized and are sent to the fusion center. The fusion center 
fuses the current quantized observations and makes a final decision. It designs (updated) quantizers to be 
used at the sensors and the fusion rule based on all previous quantized observations. Information regarding 
updated quantizers is sent back to the sensors for use at the next time. 

In IfTTI , we have presented an iterative algorithm to design the quantizers at the sensors and the fusion 
center for Bayesian distributed detection. In this paper, we extend the work in ifTTll to the situation when the 
prior probabilities and the joint pdf of conditionally dependent observations are not known. The conditional 
joint pdf is represented in a parametric form by using the copula framework. The unknown parameters 
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Figure 1 : Distributed detection system with feedback of quantizer information 



include dependence parameters and marginal parameters (parameters corresponding to marginal pdfs). MLE 
with feedback based on quantized data is proposed to estimate the unknown parameters. Its asymptotic 
efficiency can be guaranteed by employing the result that we have developed in ETI with an asymptotic 
variance which is equal to the inverse of a convex linear combination of Fisher information matrices based 
on J groups of different feedback quantizers. These estimates are iteratively used to refine the quantizers and 
the fusion rule to improve distributed detection performance by using feedback. Numerical examples show 
that the new detection method based on MLE with feedback is much better than the usual detection method 
based on the assumption of conditionally independent observations. Better detection performance can be 
obtained by increasing the number of feedbacks and the number of observations during each estimation step. 

The rest of the paper is organized as follows. Problem formulation is given in Section [H In Section 
13 copula-based parametric pdfs are constructed. MLE with feedback based on quantized data is also pro- 
posed. In Section HI an efficient distributed detection algorithm with unknown pdfs and unknown joint prior 
probabilities is presented based on quantized observations and different updated quantizers. In Section[5J nu- 
merical examples are given that exhibit the superior performance of our approach. In Section [6l concluding 
remarks are provided. 
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2 Problem Formulation 



An L-sensor Bayes detection system with two hypotheses H Q and H\ is considered. A parallel architecture 
with feedback is assumed (see Figure [T]). Each sensor acquires observations Y^, i = 1, . . . , L whose dimen- 
sion is assumed to be one for notational simplicity in this paper. The case of high dimensions can be similarly 
considered. The z-th sensor quantizes the observation vector to rj bits (r^ > 1) by r% measurable indicator 
quantization functions: 

l}{ yi ) : Vi G R -> {0, 1}; . . . ; : Vi e R {0, 1}, (1) 

for i = 1, . . . , L. Here, each binary quantizer lf(yi) partitions the space into two regions that could be 
continuous regions or union of discontinuous regions. Moreover, we denote the quantization functions by 

I(y\r) ^ i.I 1 (y 1 ) , i ...,I L (y L ) , y eW, (2) 

where 

I i (y i )±(ll(y i ),...,ll i (y i )y,i = l,...,L, (3) 

and r = Y^h=i r i * s tne tota l number of bits available to transmit observations from the sensors to the fusion 
center. Once the r^-bit binary quantized measurements Ii(Yi) are generated at sensor i, i = 1, . . . , L, they 
are transmitted to the fusion center. The fusion center then makes a final decision 0/1 based on Ii(Yi), i = 
1, . . . , L using a fusion function F(u\, . . . , UL),Ui = 0/1, i = 1, . . . , L, i.e., 

F(/ 1 (y 1 ),...,/ i (y L )) = o/i. (4) 

If the prior probabilities of hypotheses and the conditional pdfs p(yi, . . . , yi\Hj),j = 0, 1 are known, 
the goal of the distributed Bayesian detection system is to design a set of optimal sensor quantizers h(yi), 
■ ■ •> Il(vl) and an optimum fusion rule F(ui, ■ ■ ■ ,u£) such that the following Bayes cost functional is as 
small as possible. 

C(h( yi ),...,I L (y L y,F) 
± CooiVWiOU • • .,Il(Y l )) = 0\H ) + C 01 P 1 P(F(I 1 (Y 1 ), . . .,I L (Y L )) = 0|#i) 

+C 10 P P(F(I 1 (Y 1 ), . . .Jl(Y l )) = 1\H ) + CnPiP(F(/i(Yi), . . .,I L (Y L )) = l|#i), (5) 

where dj are cost coefficients; Po and Pi are the prior probabilities for the hypotheses Hq and Hi; P( 
P(ii(Yi), . . . ,Il(Yl)) = i\Hj) is the probability that the fusion center decides in favor of hypothesis i 
given hypothesis Hj,i,j = 0, 1, which can be computed based onp(yi, . . . , yi\Hj), j = 0, 1 (see, e.g., iMl). 

However, in distributed detection systems with limited bandwidth, the joint conditional pdfs are hard to 
obtain by traditional pdf estimation methods based on raw observations. In some situations, the prior proba- 
bilities of Hq and Hi are also unknown. Quantized observations and initial quantizers is all the information 
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available at the fusion center. The specific scenario considered here is that the sensors obtain observations 
which are conditionally dependent across sensors. The observations are quantized and are sent to the fu- 
sion center. The fusion center fuses the current quantized observations and makes a final decision. It also 
designs (updated) quantizers to be used at the sensors and the fusion rule based on all previous quantized 
observations. Information regarding updated quantizers is sent back to the sensors for use at the next time. 

In summary, when the prior probabilities and conditionally dependent pdfs are unknown, the fusion center 
faces the problem of how to make a decision for the current set of quantized observations and the problem of 
how to improve the detection performance by using all previous quantized observations in time. 

The first problem is how to design the quantizers and the fusion rule, which is a static problem when the 
prior probabilities and the conditional pdfs are known. Previously developed methods (see, e.g., IT7l [T5l[T6l 
[17j[T8l) can be used to solve the problem. Thus, we concentrate on how to update/estimate the unknown prior 
probabilities and conditionally dependent pdfs using all the previous quantized data. Note that the problem 
relies on the updated quantizers that are fed back to the sensors, which results in quantized observations not 
having identical distributions temporally. 



3 Copula-based Maximum Likelihood Estimation with Feedback 
3.1 Copula-based dependence modeling 

In distributed detection with dependent observations, the performance of the detection system depends on the 
exploitation of dependence among sensor measurements. In most previous works, when dependence is not 
known, independence is usually assumed across sensors for simplicity. Here, we will model dependence by 
parametric copulas. Actually, copula is a distribution function whose one-dimensional marginals are uniform. 

Lemma 3.1. (Sklar's Theorem, see H22V or H23\l ) Let F be an L-dimensional distribution function with 
marginals F±, F 2 , ■ ■ ■ , Fl. Then there exists an L-copula C{v 1, v 2 , ■ ■ ■ , vl), Vi £ [0,1], i = 1, . . . , L such 
that for all (y\, . . . , yi) in M. L , 

F(y x ,y 2 ,...,y L ) = C{F 1 {y l ),F 2 {y 2 ),...,F L {y L )). (6) 

If Fx, F 2 , . . . ,Fl are all continuous, then C is unique; otherwise, C is uniquely determined on Ran F\ x 
Ran F 2 x Ran Fl. Conversely, if C is an L-copula and F\, F 2 , . . . , Fi are distribution functions, then the 
function F defined by © is an L-dimensional distribution function with marginals F%,F 2 , . . . , Fl. 

From Sklar's Theorem, the joint pdf is equivalent to 

L 

p(yi,V2, ...,Vl) = c(F 1 (y 1 ),F 2 (y 2 ), . . .,F L (y L )) JJpi(yi), (7) 
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where Pi(yi) and Fi(yi),i = 1, ... ,L are marginal pdfs and distribution functions of continuous random 
variables respectively; c(v\, w 2 , ■ ■ ■ , Vl), V{ G [0, 1], i = 1, . . . , L is the copula density function, 

a L C(t;i,U2,---,VL) , s . 

OVi,..., OVL 

If measurements are conditionally independent, then p(yi, 2/2, ■ ■ ■ , yz,) = ^-i=\Pi{yi) and c(t>i, t>2, . . . , 
Vl) = 1. When the measurements are dependent, c(vi,V2, ■ ■ ■ ,v£) 7^ 1 and all dependence information 
among measurements is contained in c(vi, «2, . . . , vl). Thus, copula framework allows us flexibly represent 
the dependence of observations at the sensors by c(vi, V2, ■ ■ ■ , v£) which is independent of the marginal pdfs 
so that marginal pdfs can be arbitrary pdfs of continuous random variables and not be limited to Gaussian 
pdfs. Since the nonparametric copula estimation methods require heavy computations and cannot easily use 
the knowledge of quantizers, we concentrate on the parametric estimation of c(vi,V2, ■ ■ ■ , vl). Thus, the 
parametric structure c(v\, V2, ■ ■ ■ , vz\Hj, 9qj) and pi(yi\Hj, 9ij) are assumed known under hypothesis Hj, 
and then we have the joint pdf under hypothesis Hj as follows 

L 

p( yi ,y 2 , ■ ■ .,y L \H jf 0j) = c(F 1 (y 1 \H j ),F 2 (y2\H j ), . . . , F L (y L |^)|^-, 9 0j ) \\pi{yi\H j: %), (9) 

i=l 

where 6j = [9oj,dij, ■ ■ ■ > 0Lj] is the parameter vector to be estimated; 9oj is the dependence parameter and 
9±j, . . . , 9 L] are the marginal parameters under hypothesis j = 0,1. There exist many parametric structures 
of copula density c(v±, V2, . . . ,VL\Hj,0Qj) such as Clayton copula, Gumbel copula, Frank copula and Gauss 
copula, t copula etc. (see, e.g., 1231 "). The "best" copula model can be selected by criteria such as Akaike 
information criterion (AIC), AIC with a correction (AIC C ) and Bayesian information criterion (BIC) etc ( see, 
e.g., Il24l0 . Here, we assume that the copula model has been determined but its parameters are not known. 



3.2 Maximum likelihood estimation of unknown prior probabilities and parameters of pdfs 
with quantized observations 

The observation population of the i-th sensor is denoted Y%, i = 1, . . . , L. The observation samples of Y\ 
may be from Hq or H\. The joint observation population is denoted by Y = (Y[, . . . , Y[)' which has the 
following family of joint pdf: 

{p(yi,...,yL\9)} ee@ cw, (10) 

where 9 is the unknown /c-dimensional deterministic parameter vector which may include marginal parame- 
ters and dependence parameters. Note that the conditionally joint pdf under hypothesis Hj, p(yi, y 2 , ■ ■ ■ ,yL 
\Hj,9j) can be constructed by (© where 9j = [9oj,6ij, . . . , 9Lj],j = 0, 1 are parameter vectors and the 
prior probabilities of Hq and Hi are Pq and Pi = 1 — Pq respectively. Thus, we have 

p{yi,...,y L \9) = P p(yi,...,y L \H Q ,9o) + (l- P )p(y 1 ,...,y L \H u 9i), (11) 
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where 9 = [Pq, 9q, 6?i] is the parameter vector to be estimated. Note that 9q and 9% themselves are vectors. 
The true parameter vector (the clairvoyant case) is denoted by 9*. 

Let N independently and identically distributed (i.i.d.) temporal sensor observation samples and joint 
observation samples be 

% = (Ya,...,Y iN ), i = (12) 

Y = (¥(,..., YD'. (13) 

Moreover, based on the definition of quantizers dH)-®, we define the quantized sensor observation samples 
and the joint quantized observation samples as follows 

u a 0[,...,u' L y, d4) 

Ui = (U a ,...,U iN y,i = l,...,L, (15) 

U in A (Ul,...,U%), n = l,...,N, (16) 

U} n A 4(y in ),...,c/^ 4 /r( y m)) (17) 

where U is the joint quantized observation samples. We denote the quantized observation population by 
U = I(Y\r) = (7i(Yi), . . ., Il{Yl))', we know that U has a discrete/categorical distribution. Based on the 
pdf of Y and quantizers I(y\r), the probability mass function (pmf) of the quantized observation population 
Uis 

fu(ui,u 2 ,. ■ ■ ,u L \9) = P ul ,u2,...,u L for U = (ui,u 2) . . . ,u L ), (18) 

where 

(ux,U2,...,u L ) £ S u = {(ui,u 2 , ■ ■ ■ ,u L ) £ R r : 

L 

Ui is a rj -dimensional binary row vector, i = 1, . . . , L, r = r{\, (19) 

i=i 

Pui,U2,...,U L = / p(yi,y2,---,yL\0)dyidy 2 ...dy L , (20) 

J = (u 1 ,u 2 ,...,ti i ) 

Z( Ul ,u 2 ,...,u L ) = {(2/1,3/2, - • • ,Vl) ■ h(yi) = ui,h(y2) = u 2 ,. ■ ■ ,Il(vl) = u L }- (21) 
Note that fu(ui, u 2 , ■ ■ ■ , Ul\9) is determined by p(yx,y 2 , . . . ,yi\0) and sensor quantizers I\{yx), . . ., Ih{yL)- 

Thus, the quantized observation population U has a pmf parameter family {/[/(ui, u 2: . . . , UL\9)} de Q CR k 
which yields the following log likelihood function of quantized samples U by (IT8l>-(l2n>: 

N 

l(9\U) 4 hgY[fu(U ln ,U 2n ,...,U Ln \9) (22) 

n=l 
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N 

y^!og / p(y 1 ,...,y L \6)dy 1 ...dy L 

JUi(in)=Ui» Ir.(vT.)=UT.r,\ 



n=l 

2 r 



i {h(yi)=U ln ,...,I L (yL)=U Ln } 



= ^2K m logfu(u m \e) (23) 

m=l 

where K m = #{(U ln , U 2n , • • • , U Ln ) = u m € S u , n = 1, . . . , JV}, Em=i = AT; <?« is defined by 
(fT9l >; #{•} is the cardinality of the set. The parameter vector 9 is estimated by maximizing the log likelihood 
function (1231 or equivalently solving the equation: 

p(0\U) = O, (24) 

whose solution is denoted by 9. In ETl . we have considered the estimation problem in detail and have 
presented the regularity conditions for p(yi,y 2 , ■ ■ ■ ,Vl\6) an d quantizers I(y\r) that guarantee that 9 is 
asymptotically efficient. 

3.3 Maximum likelihood estimation with feedback 

As indicated earlier, to improve the detection performance in the distributed detection system, the quantizers 
are updated and fed back to the sensors for use at the following time. The quantizers I(y\r) defined in (0) 
used at a given time j, j = 1, . . . , J, are known as one group of quantizers. To distinguish different groups, 
we use superscript CO and change notations n, N to rij, Nj respectively, j = 1, . . . , J. Assume that, for the 
j-th group of quantizers /CO (y\r), Nj joint samples { {Y\ n . , . . . , Yl TIj ) }^ =1 are observed and the quantized 
observations are denoted by U^K The corresponding observation population denoted by £/"C0 whose pmf 
can be similarly defined by ( fT8l ) and be denoted by 

f^( Ul ,u 2 ,...,u L \9)J = l,...,J. (25) 

Since the samples are temporally independent, we can estimate 6 by maximizing the log likelihood 
function: 



J N 3 

1(9\UM,...,UW) = logj] II #(<,<,-■-, ^If) (26) 

j=l Tlj=l 



J Wj 
j=l rij=l 



J N 



J2 J2 log / p(y 1 ,...,y L \6)dy 1 ...dy L 
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J 2 r 

fCi')/ 



J2J2 K $ l °Zfu& m \e) (27) 

j=\ m=l 



where if^ = #{(U$. , C/ 2 ( g , . . . , C/g>. ) = u m e S u , nj = 1, . . . , Nj}, ELi #™ = % 5 « is defined 
by (fT9l >; #{•} is the cardinality of the set. Equivalently, we solve the equation: 



^l(9\U^,...,U^) = 0, (28) 

whose solution is denoted by Or. In ED, we have proved that Or is an asymptotically efficient estimator with 
an asymptotic variance equal to the inverse of a convex linear combination of Fisher information matrices 
based on J groups of different quantizers. These results are summarized in the following Lemma. 

Lemma 3.2. There are J groups of different sensor quantizers I^\y\r), j = 1, . . . , J. Assume that 
p(yi>2/2) • • • iUl\Q) an d quantizers I^'(y\r) generate the quantized observations and the quantized pmf 
fu (ui,U2, ... ,Ul\9) defined by d25| ) satisfies the regularity conditions (C1)-(C7) in [21]. The true pa- 
rameter vector is denoted by 0*. Then, 



VN(0r - 0*) — > NiO,!- 1 ^*; /«(•), . . . ,I (J) (-)) (29) 
where N = Y?j=i N ji N j ~* oo, j = 1, . . . , J, 

I-\Q*;lM{.),...jV){.)) 4 ^^X(r ; /^(.))j (30) 

= iV^iV,X(r;/W(-))j . (31) 

2~2j=i N jX{0* ; 1^ is the Cramer-Rao lower bound for N quantized observations, wherel(0*; 

is the Fisher information matrix for one quantized sample ofU^\ That is, Or is a consistent and asymptoti- 
cally efficient estimator ofO*. 



4 Distributed Detection System Design Using MLE with Feedback 

When the prior probabilities and conditional pdfs are unknown, the basic idea of the distributed detection 
system design is as follows. We begin with an initial set of quantizers at the sensors and send quantized 
observations to the fusion center. The fusion center starts with an initial fusion rule. Based on the received 
quantized observations, the fusion center computes the MLE for the unknown parameters, and obtains up- 
dated quantizers and the fusion rule. Updated quantizers are fed back to the sensors and are used to quantize 
the next set of observations. This iterative process is continued several times to continually improve the 
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parameter estimates and thereby improving detection performance. In summary, based on the MLE with 
feedback and Algorithm 1 in |fT71 which is a near-optimal iterative algorithm and can simultaneously de- 
sign the quantizers and the fusion rule when the prior probabilities and the conditionally dependent pdfs are 
known, we have the following algorithm. 

Algorithm 4.1 (Distributed detection system design based on MLE with feedback). 

Step 1: Initialize L quantizers and the fusion rule at first stage respectively, for i = 1, . . . , L, 

Inform) = 0/1, far mi = 1, . . . , M i: (32) 

= 0/1 Jor uj e S u ,j = 1, . . . ,2 L , (33) 

where 0/1 is dimensional 0/1 vector; the measurement space of the i-th sensor is discretized to Mi 
regions; S u are defined by rti9D . N\ samples are sequentially observed and quantized to binary samples 
which are sent to the fusion center. Let t = 1 and J = 1, go to next step. 

Step 2: Estimate parameter 9 at the t-th stage: the MLE with feedback Or is computed based on all previous 
quantized observations by maximizing d27D . Thus, we have p(yi,y2, ■ ■ ■ , Dl\6r), go to next step. 

Step 3: Design sensor quantizers and the fusion rule at the t-th stage: Based on p(yi, yi-, • • • , yh\^R) eind 
Algorithm 1 in M7\l . sensor quantizers and the fusion rule are iteratively searched for better detection 
performance until the termination criterion of Algorithm 1 in £77]/ is satisfied. Thus, we have the 
quantizers /.(•),« = 1, . . . , L and the fusion rule F^(-), go to next step. 

Step 4: Feedback: If t < T (T is the upper bound on the number of feedbacks), let t = t + 1 and set 
J = t. The fusion center sends the current quantizers if ^ (•), i = 1, . . . , L to the sensors, and then 
the sensors sequentially observe N t quantized samples based on the current quantizers and send them 
to the fusion center. Go to step 2. Ift>T, stop and the last quantizers are transmitted to the sensors. 

In feedback step 4, communication can be reduced by only transmitting the changes of the quantizers 
between two iteration steps to sensors. 

5 Numerical Examples 

Let us consider a binary hypothesis testing problem with two sensors 

Hq : Y\ ~ Gamma(3,4:) Y<i ~ Gamma(5,4), 

c(v\, V2\Hq) = 1 (independent copula density), (34) 

Hi : Y\ ~ Gamma(5,4:) Y2 ~ Gomma(7,4), 
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c{v 1 ,v 2 \Hi,e 1 ) = (l + e 1 )v^ l - ei v^- e '{-l + v^ +v 2 6 ')- 2 - 1 / 9 \9 1 e [-l,oo)\{0},(35) 

where the prior probability P\ and dependence parameter 9\ of hypothesis H\ are unknown and are required 
to be estimated. We denote by 6 = [Pi, 9\]. Here, we assume that the joint pdf under Hq is independent 
and marginal pdfs are known. c(vi,V2\Hi,9i) is the Clayton copula density (see e.g. (23j) which is a 
frequently used copula to model dependence. The actual value of 9 (ground truth) is that P\ = 0.2 and 
9\ = [0.5109,1.0759,2.1316] which corresponds to Spearman's dependence measure p = [0.3, 0.5, 0.7] 0. 
There is a one to one relationship between 6\ and p (see [231). 

The initial values of the quantizers chosen are h(yi) = I[3y\ — 60], 12(2/2) = /[ — 3t/2 + 60], and the 
initial fusion rule used is the OR fusion rule. For numerical computation, we take a discretization step-size 
A = 0.5, yi G [0, 60]. We denote the probability of a false alarm and the probability of detection by Pj and 
Pd respectively. 

In Figure |2l RMSEs of the MLE with feedback for the prior probability Pi are plotted based on 5000 
Monte Carlo runs. Three dependence cases with Spearman's p = [0.3, 0.5, 0.7] are considered. The feedback 
times increase from J = 2 to J = 10 and each estimation step is done after receiving 100 quantized 
observations so that the number of observations becomes from J x 100 = 200 to 1000. The cost parameters 
Coo = C11 = and C10 = 2, C01 = 1 are used in cost function Eq. ((51). Similarly, RMSEs of the MLE with 
feedback for the dependence parameter 9\ are plotted in Figure [3j 

In Figures |4]-[6l to evaluate the detection performance of Algorithm 14. II the average ROC curves based on 
500 Monte Carlo runs are compared for the following three cases: 1) Algorithm 14. 1 I based on MLE with feed- 
back, where "Algorithm 14. 11 -10*100" means the number of feedbacks J = 10 and the number of observations 
in each estimation step Nj = 100, j = 1, . . . , J. 2) Assume independence under Hi so that the joint density 
is the product of marginals and with known prior probabilities. 3) The case with known parameter values (the 
clairvoyant case). In each Monte Carlo run, 400 test observations from Hi and 1600 test observations from 
Hq are generated so that Pf and P^ can be computed respectively. To plot several points on the ROCs, the cost 
parameters C 00 = C n = and Ci = 2, C i = 2 x [0.6, 0.5, 0.4, 0.3, 0.25, 0.2, 0.15, 0.1, 0.05, 0.02] 
are used in cost function Eq. ©. 

From Figures |2]-[6j we have the following observations: 

1. From Figures |2] and [3j RMSEs decrease as the number of observations increases. However, the rate 
of decay becomes slow, especially in Figure [3j Thus, to improve performance at a later stage, more 
feedback times and samples are required. 

2. RMSE of the parameter Pi in the case of p = 0.7 is the smallest among the three cases in Figure [2] 
However, RMSE of the parameter 61 in the case of p = 0.7 is largest in Figure |3j The reason may 
be that the estimated pdf in this case is closer to the actual pdf. In addition, from Figure [3j RMSE of 

'Spearman's \p\ < 1 is a commonly used dependence measure (see |23|). 
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9% for p = 0.3 is less than those for p = 0.5 and p = 0.7. The reason may be that the value of 9\ 
corresponding to p = 0.3 is less than those corresponding to p = 0.5 and p = 0.7. 

3. From Figures [U|6l the new detection Algorithm 14. ll based on MLE with feedback is much better than 
the usual detection method based on the assumption of independent observations. For fixed number of 
observations in each estimation step, the better performance can be obtained by increasing the number 
of feedbacks from 5 to 10. For fixed the number of feedbacks 10, better performance can be obtained 
by increasing the number of observations in each estimation step, especially for the case of the larger 
dependence parameter p = 0.7. 

6 Conclusion 

In this paper, distributed Bayesian detection problems with unknown prior probabilities of hypotheses and 
unknown conditional pdfs have been considered. The conditional joint pdf was represented in a paramet- 
ric form by using the copula framework. The unknown parameters included dependence parameters and 
marginal parameters. MLE with feedback based on quantized data has been proposed to estimate the un- 
known parameters. Its asymptotic efficiency can be guaranteed by employing the result that we have de- 
veloped in ||2T1 with an asymptotic variance which is equal to the inverse of a convex linear combination 
of Fisher information matrices based on J groups of different feedback quantizers. These estimates were 
iteratively used to refine the quantizers and the fusion rule to improve distributed detection performance by 
using feedback. Numerical examples show that the new detection method based on MLE with feedback is 
much better than the usual detection method based on the assumption of conditionally independent observa- 
tions. Better detection performance can be obtained by increasing the number of feedbacks and the number 
of observations in each estimation step. 

Future work will involve distributed detection and distributed location estimation of non-ideal systems 
where sensor outputs are to be communicated through noisy, possibly coupled channels to the fusion center. 
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Figure 2: RMSEs of the prior probability P\ based on 5000 Monte Carlo runs for the cases of the dependence 
measure Spearman's p = [0.3, 0.5, 0.7]. 




Figure 3: RMSEs of the dependence parameter 9\ based on 5000 Monte Carlo runs for the cases of the 
dependence measure Spearman's p = [0.3, 0.5, 0.7] 
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ROC (Spearman's p=0.3) 




Figure 4: Comparison of ROCs for three cases with Spearman's p = 0.3. 
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Figure 5: Comparison of ROCs for three cases with Spearman's p = 0.5. 
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